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@ Colour Image quantization system. 

® A color image quantization system is described 
which utilises a look up table into which representa- 
tive color data is loaded. This data is determined by 
repeated division of original color space into K child- 
color spaces. K being equal to the number of ad- 
dresses to the LUT. The order of division is depen- 
dent upon the frequency of original image pels 
whose colors lie in each color space. Utilising the 
system, the number of pels assigned to each color 
space becomes as nearly equal as possible and 
image quality is maintained. 
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COLOUR IMAGE QUANTIZATION SYSTEM 



At the present time color displays often employ 
a color lookup table (LUT) (see Rgure 12), How- 
ever, if a frame buffer can store all the intensities of 
red, green and blue components of image data, a 
color LUT becomes unnecessary; the data read 
from the frame buffer Is used directly for video 
signals for the color display. Frequently, however, 
each of the red, the green and the blue compo- 
nents Is represented by 8 bits, and thus 24 bits are 
required for one pel of the Image data. In cases 
such as this the frame buffer requires enormous 
amounts of storage, and becomes expensive. 

To overcome this problem a colour LUT, can 
be utilised, In which the contents of the frame 
buffer are used as color Indexes to address the 
LUT. The contents of the LUT representing red, 
green and blue components of color are read and 
utilized as video signals for the color display. 
Therefore. . It is sufficient for the pel data in the 
frame buffer to just accommodate the number of 
entries of the color LUT. For example, in a case 
where the number of entries of the color LUT or 
the number of colors simultaneously displayed on 
the color display is 256, the pel data of the frame 
buffer can be represented by 8 bits (1 byte). 

At present, there are color LUT-type displays 
that can simultaneously display 8, 16. 32 or 256 
colors. When utilising such displays a color image 
may have a greater number of color than the 
number of colors available for display (for example, 
a color Image, where the intensity of each of the 
red, green and blue component Is represented by 
8 bits, has 16.7 million colors), It is important to be 
able to select the optimum number of simutta* 
neousiy displayed colors, to cause as little deterio- 
ration of image quality as possible, and to map the 
original colors of the color image to those selected 
colors simultaneously displayable. Such a tech- 
nique is called color image quantization. 

As described by P. Heckbert in "Color Image 
Quantization for Frame Buffer Display.* ACM SIQ- 
GRAPH '82, pp. 297 - 307. July. 1982, color quan- 
tization can be broadly divided into uniform sam- 
pling and adaptive sampling. Uniform sampling 
performs quantization by uniformly dividing a color 
space, and giving a representative color to each 
divided space; reloading of a LUT Is not necessary 
once the representative coior for each divided 
space has been loaded. A disadvantage of this 
technique is that image quality is significantly deg- 
raded for an input image whose colors are not 
unifomnly distributed in a color-space, but are lo- 
cally clustered. (Here, the term color-space means 
various spaces such as RGB space (Red, Green, 
Blue space), HLS space (Hue, Ughtness, Saturation 



space), GYMB space (Cyan, Yellow, Magenta, 
Black space) and L'u*v space). 

J. Tajima "Uniform Color Scale Applications to 
Computer Graphics." COMPUTER VISION. 

5 GRAPHICS, AND IMAGE PROCESSING, vol. 21, 
No. 3. pp. 305 - 325. March, 1983 discloses unh 
form sampling In an L'u'V space. L"u*v space 
means a color-space which is arranged so that 
color difference sensed by a human corresponds to 

10 a distance in the space, and is also called a uni- 
form color-space. 

Adaptive sampling is a technique where the 
contents of a lookup table change according to an 
input image to periorm the optimum quantization. 

75 Various adaptive sampling methods have been pro- 
posed, but all perform quantization by the following 
four steps. (Here we assume that an input image is 
defined in an RGB space). 

Step 1: Sample an Input Image represented 

20 by each n bits for of R, G, and B in a space with 
each "m" bits for each of R, G, and B (generally, 
m < " n), and generate a histogram. 

Step 2: Select colors to be loaded in the 
lookup table Ck" colors) (generally. 2^"* > « k). 

25 Step 3: Perfonm mapping from the sampled 

"m" bit RGB space to the lookup table. 

Step 4: Assign the corresponding color in 
the lookup table to each pel of the input image. 
Step 2 and subsequent steps determine the 

30 image quality, but the key steps for the quantiza- 
tion Itself are Steps 2 and 3; the quality of the 
quantization depends on Step 2 where "k" repre- 
sentative colors are selected, and Step 3 where 
colors "close*" to remaining colors are selected 

55 from the '1c" representative colors, and assigned, in 
Step 4, error diffusion utilising errors of the quan- 
tization of dithering (a random noise method) are 
also used in many cases. 

A known technique for performing Step 2 is 

40 listed in the following. P. Heckbert "Color Image 
Quantization for Frame Buffer Display," ACM SIG- 
GRAPH. July. 1982 discloses the popularity al- 
gorithm and the median cut algorithm. The former 
is a method that sorts a histogram in descending 

46 order of frequency, and selects "k" colors from the 
top as the representative colors. This method Is 
simple, but has a noticeable disadvantage that the 
image quality significantly deteriorates if many col- 
ors are distributed with equal frequency. 

50 The latter is a method that calculates maximum 
and minimum values in each direction of R, Q, and 
B components, and splits the space with their 
median value recursively. Extra time is necessary 
to find the maximum and the minimum values In 
each direction of R, G, and B components, and. If 
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the median values are given in real numbers, a 
major amount of processing time is required be- 
cause of real number calculation. If they are given 
in integers, there is the disadvantage that errors 
may be caused whether they are truncated or 
rounded. 

U. S. Patent No. 4,654,720 discloses the popu- 
lation equalization algorithm. It is a method that 
selects "k" representative colors while finding 
neighbourhood spaces which render the frequency 
of the "k" colors as equal as possible in the color- 
space. This method provides excellent Image qual- 
ity, but a lot of time is necessary to merge the 
neighbourhood spaces depending on the input im- 
age, and an enormous amount of storage Is re- 
quired. 

US 4, 710, 806 discloses a fixed are and chro- 
matlclty based algorithm, it Is a method in which a 
fixed area is provided in a color lookup table in 
advance, entries whose values appear In the fixed 
area are removed from the histogram before a 
histogram is generated based on the ratio between 
R. Q, and B (chromaticity). and representative col- 
ors are found according to peak values appearing 
therein. Colors in a region with constant chromatic- 
ity and varying lightness are mainly selected by 
utilizing the characteristic of the human eye that Is 
sensitive to the lightness. Existence or nonex- 
istence of the fixed area depends on an input 
image, so that it may be an advantage or a dis- 
advantage. However, a major drawback is that this 
technique requires a lot of processing time be* 
cause real number calculation is involved In a se- 
ries of processes such as generation of the histo- 
gram for brightness and detection of the peaks 
(particularly, calculation of angles such as arc co- 
sine). 

Step 3. involves finding neighbourhood repre- 
sentative color for those remaining colors with 
more than one entry In the histogram. The tech- 
nique described In US 4, 854, 720 processes them 
through merge while incrementing the distance as 
1-st neighbourhood. 2-nd neighbourhood, and so 
on. Other approaches find representative neigh- 
bourhood colours by introducing some measures of 
distance (for example, Euclidean distance in the 
RGB space). The distance calculation involved In 
finding the neighbourhood is a time-consuming 
process. 

The present invention provides a means for 
processing both Steps 2 and 3 utilising an adaptive 
sampling method at a high speed. The processing 
time and the storage required for quantization are 
proportional to the number of colors simultaneously 
displayable on the color display, and are not af- 
fected by the number of colors and the distribution 
of colors specific to the original image. Due to the 
decrease in storage required the invention can be 



implemented on a personal computer. 

A color image quantization system is presented 
in which selection of representative color data to be 
loaded into a look up table are determined by 

5 division of an original color space to generate 
child-color spaces, which in turn are repeatedly 
divided until at least k child-color spaces have 
been generated, where k equals the number of 
addresses to the LUT, the order In which the color 

10 spaces are divided being dependent upon the fre- 
quency of original image pels whose color lies 
within each color space. This arrangement 
achieves the advantage that the number of pels 
(frequency of use) assigned In each divided color- 

75 space becomes as nearly equal as possible and 
image quality is maintained. 

In a preferred embodiment the order of color- 
space division is determined by the value of a 
space-occupying number for a color-space, the 

20 number being obtained by calculating the number 
of pels of the original image with colors that lie 
within the color-space and multiplying the calcula- 
tion by a weighting-factor corresponding to the 
level of the division, the level being related to the 

25 number of times the original color-space has been 
divided to yield the color-space. In one arrange- 
ment the weighting-factor becomes larger as the 
division level becomes higher, and the color- 
spaces are divided in descending order of space- 
so occupying number. 

A method and apparatus for color image quan- 
tization Is presented which selects "k** display col- 
ors from 2^"' colors obtained by assigning ni bits 
to represent the intensity level of each of "a" kinds 

$6 of basic color (1^1^ a); and quantizies an original 
color image comprising a number of pels for which 
any one of the said 2^"* colors may be assigned 
so that it may be displayed with the said "k" 
display colors: 

40 (a) Inputting the original image, sample in a 

color-space defined by assigning mt (mi S ni) bits 
representing the intensity level of each of the "a" 
kinds of basic color, 

and generating an a-dlmension histogram, 
45 (b)Repeatlng dividing a color-space into X 

child-spaces, when calculating a space-occupying 
number by: 

calculating the number of pels assigned for colors 
within each generated child-space, refening to the 
50 histogram. 

and multiplying the calculation result by a 
weighing-factor conresponding to a level of the di- 
vision, 

. (c) Preparing a tree-structured list which de- 
55 scribes a parent-child relationship of color-spaces, 
and updating the list by registering a newly gen- 
erated color space each time a color space Is 
divided. 
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(d) Selecting "k" color spaces as representa- 
tive color spaces in the descending order of the 
space-occupying number, among those located at 
ends of the tree-structured list, 

(e) Selecting a representative color for each 
of the said "k" representative color-spaces, and 
providing the representative color with an Index. 

(f) For a color other than the representative 
color within each of the said "k- representative 
color-spaces, giving tiie index assigned for the 
representative color of tiie color-space. 

for a color witiiln a color-space other than the said 
representative color-spaces in the said tree-struc- 
tured list, finding a representative color-space lo- 
cated close to the color-space, and giving it the 
Index assigned for the found representative color- 
space, and 

(g) For each pel in the said original image, 
obtaining an index given to the color assigned for 
the pel. and storing it In a storage device. 

The above-mentioned "a" kinds of basic color 
are typically ttwse basic colors such as red. green 
and blue. However, the scope of tiie invention Is 
not limited to an Image consisting of only these 
color components. For example, In the field of 
remote sensing, a component such as ground sur- 
face temperature may be included as a basic com- 
ponent In this regard, an image to be quantized 
could be called a multi-dimensional multi-value im- 
age. However, in the following, the term "color 
image" is used for convenience. 

A specific embodiment of ttie invention will 
now be described with tfie aid of the accompany 
ing diagrams in which: 

Rgure 1 is a diagram schematically showing 
tiie entire constitution of an embodiment according 
to the Invention. 

Rgure 2 Is a diagram illustrating a histogram 
created by Step 1. 

Rgure 3 Is a flowchart for generating the 
histogram in Step 1. 

Rgure 4 is a diagram Illustrating the relation- 
ship between ttie RQB space and tiie divided 
color-spaces. 

Rgure 5 is a conceptual diagram of a di- 
vided color-space management list 

Rgure 6 is a diagram illustrating a weighing- 
factor for finding a space-occupying number. 

Rgure 7 is a conceptual diagram of a di- 
vision priority management list 

Rgure 8 Is a diagram two-dimensk)nally Il- 
lustrating tiie process for divicUng a color-space. . 

Rgures 9 and 10 are diagrams illustrating 
the process for generating tiie division priority 
management list 

Rgure 11 Is a diagram Illustrating a color- 
indexed histogram and a color lookup table. 

Rgure 12 Is a diagram schematically illus- 



trating a color display using tiie color LUT tech- 
nique. 

Rgure 13 is a diagram Illustrating the pro- 
cess flow of step 2 in detail. 
5 Rgure 14 Is a diagram iltusti^ting tiie pro- 

cess for calculating tiie tree-structured level of a 
child color-space (processor 2-1). 

Rgure 15 is a diagram illustrating tiie pro- 
cess for calculating a range of a color-space oc- 
10 cupied by a child color-space (processor 2-1). 

Rgure 16 is a diagram Illustrating tiie pro- 
cess for calculating tiie frequency of use of colors 
(counts) In tiie child color-space (processor 2-1). 
Rgure 17 is a diagram illusfrating tiie pro- 
75 cess for Inserting and sorting tiie division priority 
management list (processor 2-2). 

Rgure 18 is a diagram illustrating tiie pro- 
cess of tiie divisibility check (processor 2-5). 

Rgure 19 is a diagram Illustrating tiie pro- 
20 cess for setting color Indices In the color lookup 
table (processor 2-6). 

Rgure 20 is a diagram illustrating tiie pro- 
cess for setting color data in tiie color lookup table 
(processor 2-6). 
26 Rgure 21 is a diagram Illustrating tiie pro- 

cessing flow of Step 3 in detail. 

Figure 22 Is a diagram illustrating tiie pro- 
cess for providing tiie color indices with the parent 
color-space (processor 3-1). 
30 Rgure 23 is a diagram illustrating tiie pro- 

cess for setting tiie color indexes In the coior 
Indexed histogram (processor 3-2). 

Rgure 24 is a diagram iliustrating an exam- 
ple of the histogram. 
3$ Rgures 25 and 28 are diagrams illustrating 

examples of data for divided color-spaces after 
division into eight 

Rgures 26, and 29 tiirough 35 are diagrams 
Illustrating tiie process for generating the division 
40 priority management list 

Rgure 27 is a diagram Illustrating an exam- 
ple of the divided color-space management list. 

Rgure 36 tiirough 38 are diagrams Illustrat- 
ing an example of final divided color-space man- 
46 agement list. 

Although tiie Invention can apply to a multi- 
dimensional multi-value image. It is described as 
an apparatus for simple color image quantization 
by exemplifying a color-space consisting of red, 
50 green and blue components. 

Rgure 1 shows a schematic of apparatus for 
color Image quantization. The apparatus broadly 
consists of four units; a histogram generator, a 
representative color selector, a neighbourhood re- 
S5 presentative color mapping device, and an index 
Image generator. It is assumed tiiat each of the 
red, green and blue components of an original 
image to be displayed is ^n" bits, and that a 
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display utilising a color LUT selects and displays 
"k" colors (hereinafter called "representative col- 
ors") from a color-space consisting of "nr>" bits for 
each of the red, green, and blue components. The 
apparatus performs quantization of a color Image 
and the following describes the processing se- 
quence in conjunction with each of the above units. 

1) Step 1: Generation of histogram 

The histogram generator receives an original 
image to be displayed, finds the frequency of col- 
ors used in the Image, and outputs a histogram. 
The original image being received Is represented 
by "n" bits for each of the red (R). the green (G), 
and the blue (B) components, and the histogram 
output has "m" bits for each of R. Q. and B (n & 
m). Rgure 2 shows an example of a histogram, and 
Rgure 3 illustrates the processing sequence of the 
histogram generator. In Rgure 3, N Indicates the 
number of pels in the original Image, R(i). Q(i) and 
B(l) indicate the l-th pel data of the original image 
("n- bits for each of R. Q and B). respectively, r. g, 
and b Indicate data consisting of only significant 
"m" bits taken from data of R(j), G(l) and 8(1), 
respectively, and H (r, g, b) Indicates the frequency 
of use (count value) for elements (r, g, b) In a 
color-space represented by "m" bits for each of 
the red, the green, and the blue components. Once 
Step 1 Is completed. Step 2 is started. 



2) Step 2: Selection of representative colors 

In Step 2. the representative color selector 
recursively divides Into eight the color-space repre- 
sented by -m" bits for each of the red. the green, 
and the blue components, and finally obtains "k" 
divided color-spaces from which the representative 
colors are selected. In this case, the coior-space is 
recursively divided into eight so that the number of 
pels (frequency of use) assigned in each divided 
color-space may become as nearly equal as possi- 
ble. 

A divided color-space management list and a 
division priority management list are introduced to 
Implement the above. 

2-1) Divided color-space management list 

Because the embodiment herein treats a three- 
dimensional space having red, green, and blue 
components, the space Is divided Into eight, and 
the divided color-space management list has an 
eight-branch (oct-tree) structure. The list will be a 
four-branch (quad-tree) structure if the space is 



two-dimensional, or a 16-branch structure if it is 
four-dimensional. 

Figure 4 shows the relation between the color- 
space and eight divided spaces. At the time when 

5 the color image quantization process is started, 
each of the red. the green, and the blue compo- 
nents has a value In a range from the lower limit of 
0 to the upper limit of 2"* - 1. Rrst, the entire color- 
space is divided into eight. For the sake of conve- 

70 nience. the eight divided spaces are number from 
(1) to (8) according to the numbering practice as 
shown In Rgure 4. They are called child color- 
spaces (child-octants) to the original color-space. 
The original space is called a parent color- 

15 space (parent-octant) to those child color-spaces 
(1)to(8). • 

If the lower and the upper limits of the red, the 
• green, and the blue components of a parent color- 
space are represented by (Rmm. Rna»d» (Gnun. Gmax)> 
20 and (B„„n, Binax). those of the child color spaces are 
automatically defined according to the following 
rule. 

25 Child-octant (1) 

(Rmm. (Rmin + Rm«c)/2). (Qmln. (Qmin + G„«)/2), 
(Bmln. (Bmin + B,r^) 

30 

Child-octant (2) 

((Rmlo + Rmax)>2. R^ax). (Qmln. (Gmin + Gm»J/2), 
(Bmin, (8mln + B„ax)/2) 

Child-octant (3) 

(Rmm, (Rmin + RmaK)/2). ((Gnrfn + Gmax)/2. 
40 Gmax). (Bmbi. (Bmln + Bmax)/2) 



Child-octant (4) 

45 ((Rmin + Rm««)/2, Rmax). ((GmIn + Gmaxy2), 

Gniax)i (Bmln. (Bmin + Bmax)/2) 



Child-octant (5) 

50 

(Rmin. (Rmin + Rmax)/2). (Gmln. (Gmlo + Gma)c)/2). 
((Bmln Bmax)/2, Bmax) 



55 Child-octant (6) . 

((Rmin + Rmax)/2. Rmax). (QmIn, (GmIn + 
/2). ((Bmln + Bmax)/2. Bmax) 
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Child-octant (7) 

(Rmlft, (Rmin + Rm»c)/2), ((G^,„ + Qfn^2, 
Qmax). ((Bmm B„^2, B„,»0 



Child-octant (8) 

{(Rmin + Rmax)/2. Rm«). ((Qml« + 0^2, 

Qm«). ((B„g„ + B„«J/2. 

Each child color-space is further subject to 
division Into eight As division is repeated, the 
difference between the lower and the upper limits 
becomes smaller. 

Thus, a tree structure as shown in Rgure 5 is 
obtained. It is the divided color-space management 
list that controls this tree structure. 

Each element (node) in the divided color-space 
management list (node) has the Ibllowing Infonma- 
tlon for controlling each child color-space: 

(1) Depth of the tree structure (level) 

(2) Upper and lower limits of the red, the 
green, and the blue components of a child color* 
space. 

(3) Space-occupying number 

(4) Color index of a color looicup table (LUT) 

(5) Representative color (red, green, and 

blue) 

(6) Pointer to the parent color-space 

(7) Pointers to eight child color-spaces 

The level in the tree structure (1) has a value of 
up to •'m- at the deepest level. At the level "m." 
the upper limit coincides with the lower limit This 
means that the space cannot be divided any more 
at the level "m." The space-occupying number (3) 
can be found by multiplying the frequency of use 
in the histogram found in Step 1 by a weighing- 
factor determined according to the depth of the 
tree structure (level) (1). Rgure 6 shows an exam- 
ple of weighing-factor rules for m « 4. The color 
index of a color LUT (4) and the representative 
color (5) are set in Step 2 or 3. The pointers (6) 
and (7) are pointers connecting the parent color* 
space and the child color-space according to the 
numbering rules shown in Rgure 4 when the parent 
color-space Is divided into eight child color-spaces, 
and back pointers enabling easy reference from a 
child color space generated through division to the 
parent color space. In a case where a color space 
does not have any child color space, all the point- 
ers of (7) are empty (NULL). Also, in a case where 
the space-occupying number t>ecomes zero, the 
color space is not assigned for a memory for Its 
control, and Is treated as an empty (NULL) space. 
Therefore, some of the pointers to the child color- 
spaces may be empty (NULL). 



2-2) Division priority management list 

The division priority management list is used to 
determine which space should be divided into eight 
5 next, while a color-space is recursively divided into 
eight 

Rgure 7 shows a division priority management 
list. Each element of the list Is rearranged in de- 
scending order of the space-occupying number 
10 whenever a color-space is divided into eight Thus, 
each element (node) of the list has the following 
three pointers: 

(1) Pointer to a corresponding color-space 
element (node) in the divided color-space manage- 

15 ment list 

(2) Pointer to an element (node) that has a 
space-occupying number smaller than its space- 
occupying number, but is closest to it 

(3) Pointer to an element (node) that has a 
20 space-occupying number larger than its space-oc- 
cupying number, but is closes to it 

2-3) Procedure for selecting representative colors 

28 

Rgure 8 shows the process in which a color- 
space is divided two-dimensionally for easy under- 
standing. The numerals in the divided color-space 
of Rgure 8 Indicate examples of the space-occupy- 
so ing number. 

Rrst. a color-space Is divided into four, and 
provides four child-color spaces. At the time, the 
above-mentioned divided color-space management 
list as well as the division priority management list 
35 are generated, so that the elements are arranged in 
descending order of the space-occupying number 
(proc-1 in Rgures 8 and 9). 

Then, a child-space (A) at the top of the di- 
vision priority management list pointed by the di- 
40 vision priority controlling pointer (CPTR), or having 
the largest space-occupying number is selected as 
the object of division, and divided into four. The 
divided cobr-space management list is updated in 
the same manner as above, and the division prior- 
45 Ity management list is rearranged and updated for 
its elements In the descending order of the space- 
occupying number (proc-2 in Rgures 8 and 9). 
Such a process of division Into four Is recursively 
repeated until the number of divided color-spaces 
50 reaches "k" (the number of representative colors). 

In a case where "k" Is a very large number, 
the division of a color-space may be stopped at the 
moment when the number of color-spaces regis- 
tered in the division priority management list 
55 reaches "k." and Steps 3 and 4 are started. 

However, to attain further improvement of the 
image quality, division of the color^space, and up- 
date of the divided color-space management Qst 

6 
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and the division priority management list are furtlier 
repeated. 

When tlie number of the divided color-spaces 
becomes larger than "k." as shown In Figure 10, a 
color-space which is (k + 1) or behind In priority Is 
deleted from the division priority management list. 

In addition, after the number of the divided 
color-spaces becomes larger than "k," a child 
color-space to be divided is selected in the follow- 
ing manner. Rrst. assuming that a child color- 
space at the top of the division priority manage- 
ment list pointed by CPTR (P In Rgure 10) Is 
divided into four, if the largest value of the space- 
occupying numbers for these fdur child color- 
spaces is larger than than that of the space-oc- 
cupying number for a child color-space (R) at the 
end of the current division priority management list, 
the color-space (P) at the top of the division priority 
managemient list is divided Into four. Otherwise, 
CPTR moves to the second child color-space (Q). 
which is then selected as the object of the division 
and divided into four. The same process is re- 
peated, and the process of Step 2 is completed 
when CPTR points to the k-th child color-space R. 

The representative color selector determines 
representative colors from colors contained in "k" 
child color-spaces In the final division priority man- 
agement list generated in Step 2, and sets color 
indexes of the representative colors to correspond- 
ing "k" child color-spaces in the divided color- 
space management list It also generates a color 
lookup table (LUT) that Is a correlation table of the 
representative colors and the color Indexes (see 
Rgure 11 A). The color indexes are also set in the 
corresponding entries in the histogram. 

3) Step 3: Mapping to neighborhood representative 
color 

The neighbourhood representative color map- 
ping device determines representative colors clos- 
est to those of the original image, and sets indexes 
of the representative colors in the histogram gen- 
erated in Step 1 (see Rgure 1 1 B). Step 3 consists 
of the following two major processes. 



3-1) Process 1 

To a non-end parent color-space in the gen- 
erated divided color-space management list having 
child ponters. the color Index of the child color 
space having the largest space-occupying number 
among those with representative colors is recur- 
sively set as its color index. 



3-2) Process 2 

Neighbourhood representative colors for map- 
ping are determined in the following manner for 
5 entries of the histogram generated in Step 1 whose 
use frequency is non-zero, and which are not se- 
lected as the representative colors. 

a) If any brother color-space, which means 
color-spaces having the same parent color space, 

70 is selected as a representative color, its color index 
is provided. 

b) If there is no such color space, the color 
index of the representative color of the parent 
color-space set in Process 1 is provided. 

75 c) Thus, each node in the divided color- 

space management list, or each color-space is 
provided with one color index. Then, it is sufficient 
to find an end node, to which the color of the entry 
with non-zero frequency of use in the histogram 

20 belongs, by traversing the divided color-space 
management list for each entry, and to set the 
index provided for the node to the entry. 

25 4) Step 4: Index image- generation 

The index Image generator replaces the color 
of each pel of the original image to an index of the 
representative color by referring to the histogram 
30 with indexes of the representative colors generated 
in Step 3 to generate an index image in which a 
pel sequence is represented by an index se- 
quence. 

ss 

II. More detailed embodiment 

Now. a detailed explanation of the representa- 
tive the color selector in Step 2 of the above- 
40 mentioned embodiment, and the neighbourhood re- 
presentative color mapping device in Step 3, is 
given. It should be noted that the processor de- 
scribed in the following may be constituted by 
dedicated hardware, or by a software routine. 

1) Step 2: Selection of representative colors 

Rgure 13 shows a more detailed process flow 
so of the representative color selector. It has six pro- 
cessors. Input signals, output signals and process- 
ing procedure of each processor are described 
fc>elow. 

55 

(1) Processor 2-1 (processor for generating a di- 
vided child color-space) 
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The processor 2-1 receives the divided color- 
space data to be divided and the histogram as 
input signals, and outputs child color-space data as 
output signals. The contents of the input and the 
output signals are provided as follows: 

(Input signals) : The divided color-space to be 
divided being represented by Shi 

(1) Level of B\n (integer data) 

(2) Rmin, RmaxOf «!„ (Integer data) 

(3) Q^,^ Q„«c of 0i„ (integer data) 

(4) B„„„. Bmaxof dm (Integer data) 

(5) Three-dlmensionai histogram H (r, g. b) 
(integer data) 

(Output signals): j-th child color-space (1 ^ j ^ 8) 
being represented by 0out (I) 

The following is outputted for j = 1 to 8. 

(1) Level of tfout 0) 

(2) Rmin. Rm«c of Bom (1) 

(3) Qmln. of float (D 

(4) B^n. B max Of QoMX (1) 

(5) Counts of the histogram for $wt Q)* that 
is, total number of the frequency of use of color 
(Integer data) 

The CPU of the processor 2-1 executes the 
following operation. 

(i) Calculation of ^out 0) l^vei 

(li) Calculation of Rmln. Rm«c Qmln. Gmax. Bmln. 
Bmax. Of do«t G) 

(HI) Calculation of total number of the fre- 
quency of use of color in dout Q) 

Rgure 14 shows the procedure of operation (i). 

Rgure 1 5 shows a circuit used for the proce- 
dure of operation (ii). 

For ttie sake of simplicity, an input signal string 
Is sequentially represented by a set of four ele» 
ments. (I. j. k, SW). and an output signal string is 
represented by a set of two elements, (k, (i ^ J)/2) 
or ((i j)/2. k). By using tiiese. tiie entire operation 
process of (il) is given as follows (tiie left side of 
the arrow indicating the output string, and the right 
side indicating the input stiing): 



For do«t(l) 

(Rmfaif Rmax) _ (Rmln Of Sin* Rmax Of 0|n, Rmin Of 
fffn. ON) 

(Gmin. Gmax) _ (Qfrtn Of flui. Qmex Of 9in, Qmfn Of ^m. 
ON) 

(Bmto. Btnmd _ (Bmln Of S|„, B^ax Of dm, B„an Of Bm, 
ON) 



For dout (2) 

(Rmln. Rmaic) _ (Rmln Of «!n. Rm« Of Rmln Of 

Bin. OFF) 

S (Gmin, Gmax) _ (Gmin Of B\n. Qmax Of «Jn. Qmlti Of dm, 
ON) 

(Bmlfi. Bmax) _ (Bmln Of Bin. B^wk Of Stn. Bmln Of dbi. 
ON) 



10 

For eput (3) 

(Rmln* Rmax) (Rmln Of B\m Rmax of 9\n. Rmln Of 

Bin. ON) 

IS (Gmfn. Qmax) _ (GmIn Of flt„. Gmax Of Si„, Qmax Of Bin, 
OFF) 

(Bmln. Bmax) _ (Bmln Of Bin, B^ax Of Bmln Off S|„, 
ON) 



20 

For dout (4) 

(Rmlm Rmax) _ (Rmln Of d|„, Rmax Of 6\n, Rmax Of 
ei„. OFF) 

26 (Gmln. Qmax) _ (Qmin Of 9|n. Qmax Of Bin, Gmax <rf «ln. 
OFF) 

(Bmln. Bmax) _ (Bmln Of 0|n. Of Sm, Bmln Of Si„, 

ON) 



SO 

For Sout (5) 

(Rmln. Rmax) _ (Rmln Of ei„. Rmax Of 8^, Rmln Of 

dm, ON) 

35 (Gmln. Qmax) _ (QmIn Of Bm, Gmax Of fli„, Gmln Of Sm. 
ON) 

(Bmln. Bmax) _ (Bmln Of Bm, Bmax Of ^m, Bmax Of Sir,. 

OFF) 



40 

For Sort (6) 

(Rmln. Rmax) _ (Rmln Of B\n, Rmax Of hn, Rmax Of 

8in. OFF) 

46 (Qmin. Qmax) _ (Gmln Of Bm, Qmax Of Sm. Gmax Of S|„, 
ON) 

(Bmln. Bmax) _ (Bmln Of Bin, Bmax Of Sfr,, Bmax Of Sm. 
OFF) 



50 

Fbrtfoiit(7) 

(Rmln. Rmax) (Rmin Of d|ni Rmax Of Bin, Rmln Of 

Bin. ON) 

55 (Qmlm Qmax) _ (Gmln Of Bm, Gmax Of B\n, Gmax Of Sm. 
OFF) 

(Bmlni Bmax) (Bmln Of B\n, Bmax Off d|n, Bmax Of Sm, 

OFF) 
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For dout (8) 

(Rmtn, Rmax) _ (Rfnln Of ^m, Rmoc Of flm, Rmax Of 
0|n. OFF) 

(Qmlm Qmax) _ (Qfnln Of Oin. Gmax Of 0|„, Qmax Of 6|„, 5 
OFF) 

(Bmlnr Bmax) _ (Bmin Of Bin, Bmax Of dm. Bmax Of fl|„, 
OFF) 

The operation of QW) Is processed In the flow 
shown in Figure 16 by using the output signals of 10 
(li). 

(2)Processor 2-2 (processor for Inserting and sor- 
ting the division priority management list) 

The processor 2-2 receives a divided color- 
space to be inserted as input signals, and gen- 
erates a division priority management list inserted 
with the divided coior*space as the output signals. 

(Input signals) : The divided color-space subject to 
insertion being represented by dm 

(1) l-evel of 9in (integer data) ... being repre- 
sented by "levelin" 

(2) Total number of the frequency of use of 
color in fli„ (integer data) 

(3) ID of din (ir^eger data) 

(4) m (data of number of bits in a histogram) 

(5) (number of entries in the division 
priority management list: before insertion) 

(Output signal): 

(1) Noui (number of entries in the division 
priority management list: after insertion) 

(2) ID (i) (ID of the i-th child color-space in 
the list (1^1^ Nout) : integer data) 

(3) VAL (I) (space-occupying number for the 
l-th child color-space in the iist) 

Wherein VAL 0) Is Integer data values which 
are sorted in the descending order. The space- 
occupying number is given by the following equa- 
tion: 

Space-governing number ■ (Total number of fre- 
quency of use of color contained in the divided 
color-space) x (Weighing-factor corresponding to 
the level of the divided color-space) 

The weighing-factor provides weigliing (m + 1 
• level) times for the direction of each axis of an 
RGB space according to the level of the divided 
color-space so that it can accommodate division of 
a "m" bits space. It indicates how many times a 
wider area the space has than the state where it is 
exactly divided into "m" in the direction of the axis 
(m » level). Because the RGB space is in fact 



three-dimensional, the weighing-factor is defined as 
(m + 1 • ievel)3. 

Rgure 17 shows the processing procedure of 
the processor 2-2. 

(3) Processor 2-3 (processor for deleting the entry 
at the end of the division priority management list) 

The processor 2-3 receives the current division 
priority management list as input signals, and gen- 
erates a division priority management list, the entry 
at the end of which is deleted, as the output 
signals. 



(Input signals) : 

(1) Nr„ (number of entries in the division 
priority management list: before deletion) 

(2) ID (i) (ID of the l-th divided color-space in 
the list (1 :^ i ^ Nin) : integer data) 

(3) VAL (i) (space-occupying number for the 
i-th divided color-space in the list) 



25 

(Output signals) : 

(1) Nou, (number of entries in the division 
priority management list: after deletion) 
30 (2) ID (i) (ID of the i-th divided color-space in 

the list (1 ^ i ^ Nout) : integer data) 

(3) VAL (1) (space-occupying number for the 
i-th divided color-space in the list) 

ss (4) Processor 2-4 (processor for indicating the di- 
vision priority) 

The processor 2-4 receives the division priority 
controlling pointer CPTR and the division priority 
40 management list as the input signals, and gen- 
erates divided color-spaces (octants) as the output 
signals. 

45 (Input signals) : 

(1) CPTR (division priority controlling pointer: 
integer data) 

(2) N (number of entries in the division prior- 
50 ity management list: Integer data) 

(3) ID (i) (ID of the l-th divided color-space in 
the list (1 ^ i :S N) : integer data) 

(Output signals): flout being the divided colour- 
55 space of ID (CPTR) 

(1) Level of flout (integer data) 

(2) Rmio. Rmax Of flout (integer data) 



ISOOCID: <EP 03e6309A2J_> 



17 



EP 0 366 309 A2 



18 



(3) G„,i„. G„ax of flout (integer data) 
W Bmin. B«« of flout (integer data) 
(5) Total number of frequency of use of 
colors in flout (integer data) 

(5) Processor 2-5 (processor for Judging divisibil- 
ity) 

The processor 2-5 receives a divided color- 
space, which is a candidate of division, a division 
priority management list and a histogram as the 
input signals, and generates judgment value wheth- 
er or not it can be divided as the output signals. 

(Input signals) : Color-space subject to division 
being represented by flin 

(1) Level of fli„ (integer data) .... (being repre- 
sented by levelin) 

(2) Total number of frequency of use of 
colors in flm (Integer data) 

(3) m (data of number of bits in a histogram) 

(4) N (number of entries In the division prior- 
ity management list integer data) 

(5) ID (i) (ID of the i-th divided color-space In 
the list (1 ^ i ^ N) : integer data) 

(6) VAL (i) (space-occupying number for the 
i-th divided color-space in the list) 

(7) H (r, g, b) (value data of a 3m bit histo- 
gram) 

(Output signals): 

(1) Judgment value (ON or OFF) 

Rgure 18 shows the processing procedure. As 
shown in the figure, the processor 2-5 includes the 
processor 2-1. 



(6) Processor 2-6 (processor for generating a color 
LUT) 

The processor 2-6 receives the division priority 
management list the divided color-space manage- 
ment list and the histogram as the input signals, 
and generates a color lookup table and an updated 
divided color-space management list as the output 
signals. 



(Input signals) : fli„ 0) being the j-th divided color- 
space (1 ^ j ^ M) 

(1 ) K (number of entries in the divided color- 
space management list: integer data) 

(2) ID O) (10 of the I-th divided color-space in 
the list (1 5 i S K) : integer data) 



(3) M (total number of divided color-spaces 
In the divided color-space management list: integer 
data) 

(4) ID of flin (i) (integer data) 

5 (5) H (r, g, b) (histogram: integer data) 

(6) Rmln. ^nwx, Qmin, Q Bmfn. Bmw Of flb, Q) 

(Integer data) 

(Output signals): flout 0) being the hth divided color- 
70 space (1 S j S M) 

(1) R (i) (value of red of the i-th index (1 S i 
2 K): integer data) 

(2) Q (i) (value of green of the I-th index: 
75 integer data) 

(3) B (i) (value of blue of the I-th index: 
integer data) 

(4) Index value of flout (i) (integer data) 
Although the total number of the divided color- 

20 spaces in the divided color-space management list 
is represented by M herein, it always has a relation 
of K ^ M ^ Ne where N, is the number of non-zero 
entries in the histogram H (r, g, b). 

In this processor, only "K" out of M output 

25 signals of flout 0) (1 ^ j ^ M) are actually set with 
values. 

The processor 2-6 has the following two major 
processes. 

(I) Scan the division priority management list 
30 and set a color Index value of a con^sponding 

divided color-space in the table. 

(II) Scan the division priority management 
list, and set color data (r, g. b) of a conresponding 
color index value In the table. 

3S In fact, both (i) and (11) can be concurrently 

calculated. Figures 19 and 20 show their process- 
ing flows. 

The processing flow of Rgure 20 determines 
an average value obtained from color data of colors 

40 contained in a representative color-space weighed 
by the frequency of use of that color, as a repre- 
sentative color. Of course, a color with the highest 
frequency In the representative color-space may be 
selected as the representative color, but the pro- 

45 cess as shown in Rgure 20 is preferable when 
taking image quality into consideration. 

Once the representath^e color is determined, a 
color Index is set to a corresponding entry in the 
histogram. 

50 

2) Step 3: Mapping to neighbouring representative 
color 

55 Figure 21 shows the processing flow of the 

neighbourhood repreeentath/e color mapping de- 
vice. TTne device has two processors. The following 
shows input signals, output signals, and processing 



10 



ISOOCID: <EP_0ae630QA2J_> 



19 



EP 0 366 309 A2 



20 



flows of each processor. 

(1) Processor 3-1 (processor for providing color 
index to parent color-space) 

The processor 3-1 receives the divided color- 
space management list as the input signals, sets a 
color index of a child color-space with the largest 
space-occupying number to the parent color-space 
In the list, and generates an updated divided color- 
space management list as the output signals. 

(Input signals) : The root divided color-space of the 
divided color-space management list to be repre- 
sented by 0\n 

(1) Index value of em (integer data) 

(2) ID of flin (integer data) 

(3) Parent color-space flag of dm (integer 

data) 

(4) Child color-space ID of dm (integer data) 

(5) M (total number of divided color-spaces: 
integer data) 

(Output signals): The j-th divided color-space to be 
represented by dout (i) ^ J ^ ^) 

(1) Index value of O^m (i) 

This processor can be very simply described 
by using recursive processing. Only an initial value 
and the root divided color-space of the divided 
color-space management list are given as the input 
signals. Then, the process is performed In the flow 
as shown In Rgure 22. However, it is assumed that 
large integers are sot in the divided color-space 
management list for the divided color-spaces other 
than those having the index values (value of 1 to K) 
set by the processor 2-6. Because a child color- 
space with the largest space-occupying number 
appears at the top of the division priority manage- 
ment list, it corresponds to the space with the 
smallest index value. 



(2) Processor 3-2 (processor for generating color 
index portion of a histogram) 

The processor 3-2 receives a histogram with a 
color index having non-zero entries of Ne (Rgure 
1 1 B). a color lookup table having "k" color Indexes, 
and the divided color-space management list as 
the input signals, and generates an updated histo- 
gram with color indices. 



(Input signals) : The root divided color-space of the 



divided color-space management list to be repre- 
sented by 9fn 

(1) H (r. g. b) (frequency of use portion of a 
5 histogram: integer data) 

(2) I (r, g, b) (color index portion of the 
histogram: integer data) 

(3) Index value of 0^ (integer data) 

(4) ID of flm (integer data) 

10 (5) Parent color-space flag of Qm (integer 

data) 

(6) Child color-space ID of Qm (integer data) 

(7) M (total number of divided color-spaces: 
integer data) 

16 (8) R (1), Q (i), B (I) (color lookup table: 

Integer data) 

(9) K (number of colors to be given: integer 

data) 



) (histogram with color index (color 
iteger data) 

shows the processing flow of the 
Vs shown in the figure, the process 
for providing the color Index of the neighbourhood 
representative color is performed by traversing the 
divided color-space management list provided with 
the color index as described above. 



111. Example of execution 

Examples of output results from each step are 
35 indicated by assuming that an original image has 
256 pels, the number of representative colors k » 
10, number of bits of each component of red. 
green and blue of a color space for a histogram m 
a 4. 



Ill-I. Step 1 

A histogram (4 bits for each of R, (3, and B) is 
45 created from the original image (Figure 24). 



Ill-ti. Step 2 

60 (1) Because the number of non-zero entries 

in the lilstogram (15) is larger than k(10). the color- 
space is divided into eight by the processor 2-1. 
Rgure 25 shows the result. Rgures 26 and 27 
show the division priority management list and the 

55 divided color-space management list at that mo- 
ment, respectively. 

(2) It Is assumed that N Is the number of 
elements in the division priority management list 



20 (Output signals): 

(1) I (r. g. b) 
index portion): int< 
Rgure 23 sh 
25 processor 3-2. As 
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Because N < k (N « 4, k » 10), the color-space 
(2) is selected as the color-space subject to the 
dividing process. Then, It is divided Into eight. It 
should be noted that notation (2H1) means that the 
parent is divided color-space (2) and the child is 
(1 ). Rgure 28 shows the result of division. 
The processor 2-2 inserts and sorts, these child- 
spaces. The divided color-spaces are arranged in 
the descending order of the space-occupying num- 
ber that is the total number of the frequency of use 
of coior weighed by level. The weighing-factor is 
given by the rule shown in Rgure 6. 
Thus, the division priority management list shown 
in Rgure 29 is obtained. The value in the parenthe* 
ses is obtained by multiplying the total frequency 
number by the weighing-factor (space-occupying 
number). 

(3) Because N < k (N = 8, k « 10), the 
divided color-space (8) is selected as the divided 
color-space subject to the dividing process, and 
divided into eight. The resultant division priority 
management list is shown in Rgure 30. 

(4) Because N < k (N « 9, k = 10). the 
divided color-space (8)-(2) Is selected as the di- 
vided color-space subject to the dividing process, 
and divided into eight The resultant division prior- 
ity management list Is shown in Rgure 31. 

(5) Because N » k is attained, the processor 
2-5 subsequently checks the divisibility in the di- 
viding process. 

Because CPTR is not equal to k, the divided color- 
space (2)-(2) is selected as the divided color-space 
subject to the dividing process. 

Divisibility check: 

Assuming that (2)-{2) Is divided, the child color 
space with the highest frequency Is (2)-(2)-(1). The 
value of it multiplied with the weighing-factor is 
8-50 = 400. which is larger than the space-occupy- 
ing number (8) for the last entry of the division 
priority management list Thus, it Is actually di- 
vided. The resultant division priority management 
list is shown in Figure 32. 

At that moment because N > k. divided color- 
spaces M a N • k are deleted from the end of the 
division priority management list by the processor 
2-3. That is. the entry of (2)-(2)-{0) is deleted. 

(6) Because CPTR is not equal to k, the 
divided color-space (2)-(8) is selected as the di- 
vided color-space subject to the dividing process. 

Divisibility check: 

Assuming that (2)-(8) Is divided, the child color 
space with the highest frequency is (2)-(8)-(3). The 
value of ft multiplied with the weighing-factor is 
8-30 = 240, which Is larger than the value of the 



last entry (8) of the division priority management 
list. Thus, it is actually divided. The resultant di- 
vision priority management list Is shown in Rgure 
33. 

5 At that moment, because N > k is attained again, 
divided color-spaces only to the number of M » N 
- k ( s 2) are deleted from the end of the division 
priority management list by the processor 2-3. 

(7) The dividing process Is sequentially ex- 

10 ecuted up to the divided color-spaces <2)-(4). (3). 
(8)-(2)-(1). and (2)-(6) in exactly the same manner, 
the division priority management list Is as shown in 
Rgure 34. 

Until this point CPTR always points to the top 

15 element. However, if the divided color-space (2)- 
(2)-(l) Is then selected and checked for divisibility, 
the one with the highest frequency of supposed 
child color-spaces is (2)-(2)-<1 )-(7). However, the 
value multiplied with the weighing-factor is only 50. 

20 This Is smaller than the value of the end of the 
division priority management list Therefore, it is 
not divided. Thus, CPTR _ CPTR + 1 is attained, 
which means that the divided color-space (2)-(2)-(1) 
Is selected as the first object for output 

25 (8) Because CPTR (2) is not equal to k. it is 

intended to perform a similar dividing process with 
the divisibility check. The divisibility check judges 
that neither divided color-space of (2)-(4)-(7) nor 
(2)-{6)-{4) can be divided any more, and CPTR Is 

30 incremented twice and becomes 4. 

Because the color-space (8)-(6)-(2) that is one of 
supposed color-spaces of the divided color-space 
{8H6) has the largest space-occupying number 
(160). the color-space (8)-(6) is actually divided, 

36 and its child color-spaces are inserted and sorted 
in the division priority management list The same 
is true of the divided color-space (3)-(8). Because 
the supposed color-space (3)-{8)-(4) has the space- 
occupying number of 160, the color-space (3)-(8) Is 

40 actually divided, and its child color-spaces are in- 
serted and sorted in the division priority manage- 
ment list At that moment the list after the CPTR Is 
as shown in Rgure 35. 

(9) Then, all of the divided color-spaces 

45 pointed by the CPTR are rejected In the divisibility 
check, so that only the CPTR is repeatedly Incre- 
mented and reaches the divided color-space (2)-<5) 
at the end of the division priority management list. 
Thus, CPTR = k Is attained. Rnally, the processor 

50 2-6 provides color Indices for the representative 
cok^rs (r. g, b) corresponding to divided color- 
spaces from the top of the division priority man- 
agement list 

55 Ill-Ill. Step 3 

The dhnded color-space management list ot>- 
tained is shown in Rg. 3. 

12 
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In the figure, a single circle represents each 
divided color-space, the upper part of which in- 
dicates the frequency of use of the contained color, 
while the lower part Indicates the color Index in the 
color LUT. Although the divided color-space man- 
agement list actually contains the space-occupying 
number, the total number of frequency of use of 
colors contained in each space is indicated in the 
figure for convenience. A double circle represents 
a divided color-space remaining In the division 
priority management list obtained In Step 2 which a 
color index was assigned to in advance. 

(1) The first process in Step 3 Is one In 
which each non-end node in the divided color- 
space management list of Figure 36 Is set with the 
child divided color-space of the highest frequency 
of use from its divided color-spaces, or the one 
with the largest space-occupying number. Rgure 
37 shows the result of the setting. 

(2) The second process in Step 3 Is one in 
which the color index is set for the end node for 
which the color Index is not yet set while looking 
for It In the neighbourhood. (No calculation is made 
for distance.) Its rule is to: 

<a> First., look for a brother divided color-space 

(from the closest one), and 

<b> If there is no brother, or If a color index is not 

set for a brother, ft any. look for the color index that 

was set to the parent color-space In the' above first 

process. 

In this example, the result of setting is as 
shown In Figure 38 according to <a>. 

At this moment, all color indices are found, and 
there is no case where <b> is applied. 
Even if, as In the case of the divided color-space 
(8)-(2)-(3), no Index is set for the brother (8)-(2)-(1) 
in the initial stage, the color Index is set in Step 1. 
so that there is no need to refer to the parent color- 
space (8)-(2) by applying the rule <b>. 
Subsequently, as described, color Indexes are pro- 
vided for non-zero entries In the histogram for 
which fio color index is yet provided by traversing 
the divided color-space management list deter- 
mined as in Figures 36 through 38, These color 
indices are then set in the histogram. 



m-IV. Step 4 

An index Image is created by using applicable 
color index values, which are determined by refer- 
ring to the color indexed histogram based on the 
values of r, g. and b (4 bit values that were made 
the entries of the histogram in Step 1) of the 
original image while scanning it 
Although a specific embodiment has been de- 
scribed a number of variations may be possible. 

For example, in the above embodiment, when- 



ever the division priority management list is up- 
dated, its elements are rearranged in descending 
order of space-occupying number, so that the di- 
vision priority controlling pointer (CPTR) points to 

5 an element as close to the top of the list as 
possible, or the one with as large a space-occupy- 
ing number as possible. However, the division pri- 
ority management list is not necessarily sorted. Of 
course, in that case, the process for determining 

10 the element pointed by the CPTR is more com- 
plicated. 

In addition, in the above embodiment, the en- 
tries of the histogram store data of corresponding 
color indexes. However, it Is possible to create a 

75 correlation table between the color and the color 
index separate from the histogram. 

Furthermore, even If the embodiment de- 
scribed, it is a matter of course that some steps 
may be changed in the sequence of the process. 

20 For example, setting of the color indexes in the 
histogram may be conducted In Step 3 for all 
entries. 

As previously stated, the color-space subject to 
the division is not limited to three dimensions. In 

25 the above embodiment, although an equal number 
of bits are assigned to each basic component it Is 
possible that a color-space to be subject to division 
in which the number of bits assigned to a basic 
component differs from that for another component- 

30 In this case, the number of divisions for each time 
other than 2 may be set for the baste component in 
its axial direction. Of course. In the three-dimen- 
sional cubic color-space, as in the above embodi- 
ment the number of divisions for each time' may 

35 be intentionally set to a number other th^ 8. 

This Invention provides a hIgK-speed method 
and an apparatus for color Image quantization uti- 
lizing an adaptive sampling technique in which the 
processing time is substantially determined by the 

40 number of simultaneously displayed colors to be 
selected, but is not affected by the number of 
colors or the color distribution in the original image. 

Factors contributing to the improvement in the 
speed of color image quantization are that all cal- 

45 culations necessary for selecting the representative 
colors can be periormed by integer operation, and 
that there Is no need for calculation of the distance 
mapping to neighbouring representative colors. 
All that is required as data are a histogram, a 

50 divided color-space management list, and a di- 
vision priority management list, so that the required 
storage capacity may be small. Accordingly the 
invention can be implemented on a personal com- 
puter. 

55 In addition, it is arranged that the divisibility of 

a color-space can be determined by introducing- a 
weighing-factor which depends on the division lev- 
el, so that, in a case where the original image* does 
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not have coloring that is not uniformly distributed in 
color-space, but has a numlser of local peaks, it is 
possible to avoid dropping of tiie colors represent- 
ing a color group that are of low density in the 
color-space, but are widely distributed (they are 
often colors for accent). Therefore, it is possible to 
prevent degrading of the quantized image. 



Claims 

1 . A color image quantization system In which 
selection of representative color data to be loaded 
Into a lookup table (LUT) are determined by di- 
vision of an original color space to generate child- 
color spaces, which in tum are repeatedly divided 
until at least k child-color spaces have been gen- 
erated, where k equals the number of addresses to 
the LUT. the order in which the color spaces are 
divided being dependent upon the frequency of 
orignal image pels whose color lies within each 
color space.. 

2. A color image quantization system as 
claimed in Claim 1. in whicji the order of color- 
space division is determned by the value of a 
space-occupying number for the color-space, said 
number being obtained by calculating the number 
of pels of the original Image with colors that lie 
within a color-space and multiplying the calculation 
by a weighing-factor corresponding to the level of 
the division, the level being related to the number 
of times the original color-space has been divided 
to yield the coior-space. 

3. A color image quantization system as 
claimed in Claim 2, wherein the weighing-factor 
becomes larger as the division level becomes high- 
er. 

4. A color image quantization system as 
claimed in any of Claims 2, 3 or 4 wherein the 
color-spaces are divided in descending order of 
space-occupying number. 

5. A method for color image quantization which 
comprises selecting -k" display colors among 2^"' 
colors obtained by assigning ni bits to represent 
the intensity level of each of "a" kinds of basic 
color (1 ^ i S a), and quantizing original color 
image comprising a number of pels for which any 
one of said 2^"^ colors may be assigned so that it 
may be displayed with the said "k" display colors, 
further comprising: 

(a) inputting the original image, sampling it in 
a color-space defined by assigning m\ (m^ S r\\) bits 
for representing intensity level of each of the said 
"a" kinds of basic color. 

and generating an a-dimension histogram, 

(b) repeating dividing a color-space Into X 
child-spaces, when calculating a space-occupying 
number by: 



calculating the number of pels assigned for colors 
within each generated child-space, referring to the 
histogram. 

and multiplying the calculation result by a 
5 weighing-factor corresponding to a level of the di- 
vision. 

(c) preparing a tree-structured list which de- 
scribes a parent-child relationship of color-spaces, 
and updating the list by registering a newly gen- 
10 erated color space each time a color space is 
divided, 

<d) selecting "k" color spaces as representa- 
tive color spaces in descending order of the space- 
occupying number, among those located at ends of 
16 the tree-structured list. 

(e) selecting a representative color for each 
of the said "k" representative color-spaces, and 
providing the representative color with an index, 

(f) for a color other than the representative 
20 color within each of the said "k" representative 

color-spaces, giving the index assigned for the 
representative color of the color-space, 
for a color within a color-space other than the said 
representative color-spaces in the said tree-struc* 
25 tured list, finding a representative color-space lo- 
cated close to the color-space, and giving it the 
index assigned for the found representative color- 
space. 

(g) for each pel in the said original image. 
30 obtaining an index given to the color assigned for 

the pel, and storing it in a storage means. 

(6) A method for color image quantization 
which connprises selecting "k" display colors 
among 2^"^ colors obtained by assigning n\ bits for 

35 representing the Intensity level of each of *'a" kinds 
of basic color (1 S i S a), and quantizing original 
color Image comprising a number of pels for which 
any one of the said 2^"' colors may be assigned 
so that it may be displayed with the said "k" 

40 display colors, further comprising: 

(a) inputting the said original image, sam- 
pling It in a color-space defined by assigning mt - 
(mi S ni) bits for representing intensity level of each 
of the said "a" kinds of basic color. 

45 and generating an a-dlmension histogram, 

(b) repeating dividing a color-space into X 
child-spaces, when calculating a space-occuping 
number by: 

calculating the number of pels assigned for colors 
50 within each generated child-space, refening to the 
said histogram, 

and multiplying the calculation result by a 
weighing-factor corresponding to a level of the di- 
vision, 

55 (c) preparing a tree-structured list which de- 

scribes a parent-child relationship of color-spaces, 
and updating the list by registering a newly gen- 
erated color space each time a color space is 
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divided, 

(d) whenever said list is updated, selecting 
up to -k" color spaces In descending order of tlie 
space-occupying number, among those located at 
ends of the tree-structured list, 

(e) judging the divisibility of each of said 
selected color spaces in the descending order of 
space-occupying number of said color-space, 
selecting said color-space as the representative 
color space if it is not divisible, or 

selecting said color-space as the object of division 
if it is divisible, 

(0 stopping the division of the color-space at 
the time when the number of the representative 
color-spaces reaches "k", 

(g) selecting a representative color for each 
of the said "k" representative color-spaces, and 
providing the representative color with an Index, 

(h) for a color other than the representative 
color within each of the said "k" representative 
coior-spaces, giving the index assigned 

for the representative color of the color-space, 
for a color within a color-space other than the said 
representativexolor-spaces in the said tree-struc- 
tured list, finding a representative color-space lo- 
cated close to the color-space, and giving it the 
index assigned for the found representative color- 
space, 

(1) for each pel in the said original image, 
obtaining an index given to the color assigned for 
the pel, and storing it in a storage device. 

(7) An apparatus for color Image quantization 
which comprises selecting "k" display colors 
among 2^"* colors obtained by assigning ni bits for 
representing the intensity level of each of "a" kinds 
of basic color (1 S i ^ a), and quantizing original 
color Image comprising a number of pels for which 
any one of said 2^"' colors may be assigned so 
that It may be displayed with the said "k" display 
colors, further comprising: 

(a) means for inputting the said original Im- 
age, sampling it in a color-space defined by as- 
signing mi (mi ^ ni) bits for representing Intensity 
level of each of the said "a" kinds of basic color, 
and generating ah a-dimension histogram, 

(b) means for calculating a space-occupying 
number by: 

(b1) whenever a color-space subject to di- 
vision is selected, dividing said selected color- 
space into X child color-spaces, 

(b2) providing an identifier for the child 
color-space generated through the division. 

(b3) generating pointer data for relating said 
child space to the parent space, 

(b4) calculating the number of pels assigned 
for colors within said generated child-space, by 
referring to the said histogram, 
and multiplying the calculation result by a 



weighing-factor corresponding to a level of the di- 
vision, 

(c) the first list for controlling data obtained 
from the operations of said (b2) and (t)4). based on 

5 the pointer data obtained from the operation of said 
(bS), 

(d) means for registering child spaces at 
least the space-occupying number of which is non- 
zero, In said first list each time the color-space Is 

10 divided. 

(e) the second list for registering the identifi- 
ers and the space-occupying number of the gen* 
erated color-spaces, 

(f) means for, whenever a color-space is 
T5 divided, cancelling registration of the divided color- 
space in the said second list, and for registering 
newly generated color-spaces in said second Hst. 

(g) means for counting the number N of 
r color-spaces registered in the second list, and, 

20 when N exceeds k, cancelling registration of (N -k) 
color-spaces from the second list in the ascending 
order of the space-occupying number, 

(h) means for, whenever said second list is 
updated: 

25 (hi) selecting the divisible color-space with 

the largest space-occupying number as an object 
of division from those contained in the updated 
color-space list, 

(h2) in a case where said count N reaches 

30 "k", calculating the maximum value of the space- 
occupying number of child spaces that would be 
obtained if the selected color-space were divided, 
comparing said maximum value with the minimum 
value of the space-occupying numbers for the 

35 color-spaces in the current second list, and judging 
the divisibility of the selected color-space based on 
said comparison. 

(h3) in a case where the color-space se- 
lected is judged not to be divisible by said com- 

40 parison. cancelling the selection of said color-space 
as the object of division, and then repeating the 
' operations of (hi) and (h2), for the divisible color- 
space remaining in the said second list, 

(i) means for stopping the division of the 
45 color-space when all color-spaces in said second 

list are judged not to be divisible, 

(j) means for selecting a representative color 
for each of the color-spaces registered in the said 
second list after the division of the color-space, and 
50 providing the representative color with an index, 

(k) means for providing colors in the color- 
spaces registered in said second list with the index 
provided for the representative color of said color- 
space, and 

55 for colors in the color-space not registered in said 
second list, for finding a color-space in said second 
list located in the neighbourhood of said color- 
space by scanning said first list, and providing it 
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with the index provided for the representative color 
of said found color-space: and 

(I) means for finding an Index provided for a 
color assigned to each pel of said original image, 
and storing the found Index in a storage device. 

(8) An apparatus for color imago quantization 
which comprises selecting "k" display colors from 
2*** colors obtained by assigning n bits for repre- 
senting the intensity level of each of "a" kinds of 
basic color, and quantizing the original color Image 
comprising a number of pels for which any number 
of colors may be assigned so that It may be 
displayed with the selected display colros. further 
comprising: 

(a) means for inputting, the said original im- 
age, sampling it in a color-space defined by as- 
signing m bits for representing intensity level of 
each of the said "a" kinds of basic color. 

and generating an a-dimension histogram, 

(b) means for calculating a space-occupying 
number by: 

(b1) regularly dividing an a-dimenslon color- 
space into X, 

(b2) providing Identifiers for the child color- 
spaces generated through the division, 

(b3) generating pointer data for relating said 
child spaces to the parent space. 

(b4) calculating the number of pels of the 
original image assigned for colors within the di- 
vided child-space, by refening to the said histo- 
gram, 

and multiplying said calculation result by a 
welghing*factor conresponding to a level of the di- 
vision, 

(c) means repeating operations of: 

further evenly dividing a child-color space with a 
large space-occuping number into X so that the 
space-occupying numbers of the child color-spaces 
are balanced, and 

executing the operations of (b2), (bS) and (b4). 

(d) a divided color-space management list 
controlling the data obtained from the operations of 
said (b2) and (b4) in a tree^structure based on the 
pointer data obtained from the operation of said 
(b3). 

(e) means for registering child spaces at 
least the space-occupying number of which is non- 
zero, as color-space elements In said divided color- 
space controlling list whenever the division by said 
means (b) or (c) Is perfonned. 

(f) division priority management list of color- 
spaces for registering identifiers and space-occu- 
pying number of the color-spaces divided by said 
means (b) or (c), 

(g) means for. whenever a color-space is 
divided by said means (b) or (c), registered newiy 
generated color-spaces in the division priority man- 
agement list, and for rearranging the color-space 



elements in said list in the descending order of the 
space-occupying number, 

(h) a means for cancelling the registration of 
(N - k) color-spaces from the division priority man- 

6 agement list In the ascending order of the space- 
occupying number when the number N of the 
color-space elements registered in the division pri- 
ority management list exceeds said "k." 

(i) a means for. whenever said division prior- 
10 ity management list Is updated: 

(11) selecting a color-space generated by the 
division less than '*m'' times but having the largest 
space-occupying number in the updated division 
priority management list as the color-space subject 

IS to the division by said means (c). or 

(12) in a case where the number N of the 
color-space elements registered in said division 
priority management list reaches "k," selecting a 
candidate color-space for division In the descend* 

20 Ing order of the space-occupying number, and cal- 
culating the maximum value of the space-occupy 
ing numbers for child spaces obtained by sup* 
posedly dividing said candidate color-space evenly 
into X. comparing said maximum value with the 

28 minimum value of the space-occupying for the 
color-spaces in the division priority management 
list, and selecting said candidate color- space as 
the olor-space subject to the division by said 
means (c) If the fomier is larger than the latter, and 

30 (13) Judging that said candidate color-space 

is not divisible If said comparison reveals that the 
former Is not greater than the latter, and then 
repeating the said operation of (12) for a color- 
space in said division priority management list that 

35 is not yet selected as the candidate for the division, 
0) means for stopping the division of color- 
space when all color-spaces in said division priority 
management list are Judged to be not divisible by 
said means 0), 

40 (k) means selecting a color representing 

each of color-spaces registered in said division 
priority management list after stopping the division, 
providing a color Index for said representative col- 
or, and generating a color lookup table. 

46 (I) a means for providing the color Index for 

the color-space determined by said means 0) fo«' a 
corresponding color-space In the division priority 
management list as well, and providing a parent 
color-space having child color-spaces In the di- 
sc? vision priority management list with the color Index 
for the child color-space having the largest space- 
occupying number recursively. 

(m) means for finding for a color-space not 
yet provided with a color index in said division 

55 priority management list a color Indexed color- 
space located on the tree-structure in the neighbor- 
hood of said color-space, and providing the color 
Index provided lor the found neighborhood coior- 
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Space to said color-space not yet provided with a 
color index, and 

(n) a means for determining to which color- 
space in the divided color-space management list 
the color assigned to each pel of said original 5 
image belongs, and storing the color index pro- 
vided for the determined color space in a memory 
for display. 

In addition, it is anranged that the divisibility of a 
color-space can be determined by introducing a io 
weighing-factor which depends on the division lev- 
el, so that, in a case where the original image does 
not have coloring that is not uniformly distributed In 
the color-space, but has a number of local pealcs, it 
Is possible to avoid dropping of the colors repre- i$ 
senting a color group that are of low density in the 
color-space, but are widely distributed (they are 
often colors for accent). Therefore, it Is possible to 
prevent degrading of the quality of the quantized 
image. ^ 

(9) A method of color image quantization as 
claimed In Claims 5 or 6. wherein said "a" kinds of 
component are basis colors. 

(10) An apparatus for color image quantization 

as claimed in Claim 8, wherein X is equal to 2^. 25 
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